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Abstract 

We study an active random walker model in which a particle's motion is determined by a self- 
generated field. The field encodes information about the particle's path history. This leads to either 
self-attractive or self-repelling behavior. For self-repelling behavior, we find a phase transition in 
the dynamics: when the coupling between the field and the walker exceeds a critical value, the 
particle's behavior changes from renormalized diffusion to one characterized by a diverging diffusion 
coefficient. The dynamical behavior for all cases is surprisingly independent of dimension and of 
the noise amplitude. 
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Active walkers are random walkers whose motion is determined by a potential surface 
which is amenable to change by the walkers themselves [| . They are one of several different 
classes of random walks in which walkers interact with their path history. The memory 
of these walkers leads to interesting properties, uncommon to pure random walks. Other 
common types of such self-interacting walks are the reinforced random walk 12, 31 and the 
self-avoiding random walk |5J. 

Models based on active walkers have been used to study a number of phenomena, includ- 
ing ant foraging patterns j§] , traffic Q , the formation of human and animal trail systems 
animal mobility chemotactic aggregation 11] and the self-assembly of networks 
The advantage of formulating problems in such a formalism is that it enables analytic study 
using methods from statistical physics and the general theory of stochastic processes. In this 
article, we analyze in detail a fairly generic type of active walker model, in which a particle 
interacts with its path history by means of a self-generated field. This model is related to the 
self-driven many particle system first introduced by Schweitzer and Schimansky-Geier 
which studied it by means of a mean-field approximation applied on the stochastic model. 
Newman and Grima ^j] analyzed the effect of fluctuations on the system's dynamics by 
means of a many-body theory approach. The spatio-temporal correlations make the prob- 
lem difficult to understand, usually confining analysis to the case of weak coupling between 
particles and the generated field llll] or to the case of small noise 101. Indeed even the case 

nnn 

of a single self-driven particle is non- trivial 15, 10, 13, see for example] . We study a variant of 
the single self-driven particle model and develop a general theory to elucidate the particle's 
rich and complex dynamical behavior. This approach differs from the previous ones, in that 
it is valid for all coupling strengths and for both weak and strong noise. The model is poten- 
tially applicable to understanding a chemotactic biological system under certain conditions, 
a topic briefly discussed at the end of this article. 

Consider a random walker whose motion is described by the following coupled equations: 

mx c (t) + x c (t) =£(t) + K aVln0(x c ,t), (1) 
d t 0(x, t) = D l V 2 0(x, t) - A0(x, t) + P5(x - x c (t)). (2) 

Eq. (0) is a Langevin equation describing the motion of a walker with mass m. The stochas- 
tic variable £ is white noise defined through the statistical averages: — an d 
it')) — 2Do5ij5(t — t'), where i and j refer to the spatial components of the noise 



vectors. The mass is assumed to satisfy the condition m C 1, implying that in the absence 
of self-interaction the walker's dynamics are of the over-damped type. The walker's diffusion 
coefficient in this case is D . The self-generated field is denoted by 0; its temporal dynamics 
are determined by the react ion- diffusion equation Eq.(J2J). We shall refer to the field as a 
chemical field since this is most consistent with a physical interpretation of Eq.(J2J). Then 
the latter equation describes the continuous local release of chemical by the walker at a rate 
/3, the diffusion of the chemical with diffusion coefficient D% and its decay at a constant rate 
A. 

The self-interaction comes from the second term on the R.H.S. of Eq.(£Q). This term 
implies that the walker's motion is partly determined by the local gradient of the field. 
Note that the field encodes information about the walker's path history, meaning that the 
walker's motion at any given time is a complicated function of its previous whereabouts. The 
strength of the coupling between the field and the walker's motion is determined by a. The 
constant k can take values 1 or —1: for k = 1, the walker tends to explore regions already 
visited (a self-attracting walker) whereas for k — — 1 the opposite is true (a self-repelling 
walker). We assume that the initial chemical concentration is described by some function 
0o ( x >£) which is greater than zero at all points in space. 

The Langevin formulation is not usually considered the most convenient representation for 
the purposes of analytic calculations and so it is customary to derive a differential equation 
for the single-particle probability distribution [ill for example]. For the problem at hand, 
this approach does not permit much analytic progress in understanding the walker's behav- 
ior. Applying a mean field approximation on the differential equation for the single-particle 
probability distribution one obtains a Fokker-Planck type equation, which then permits a 
perturbative analysis in a coupling parameter. This approach ignores the important spatio- 
temporal correlations inherent in the problem and enables one to understand the walker's 
behavior only when the coupling strength a is very small. The non-markovian nature of the 
problem makes its solution a challenging task. 

We here present a simple method to extract the asymptotic behavior of the active walker 
model. The results can also be reproduced by the method described in [h]]. However the 
method to be presented here is more transparent and gives a physically tractable picture of 
the complex underlying dynamics. Its main advantages are that spatio-temporal correlations 
are not ignored and that it enables an understanding of the motile behavior for all values of 
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the coupling strength and of the other parameters. We start by switching to a description 
in discrete time t = nAt where n G N. Space is continuous. The walker's position at 
time t + At is determined by the gradient of the logarithm of the chemical concentration 
it measures at time t. Since the walker secretes an amount of chemical /3At at every time 
step, then if the walker is at position x c (t) at time t, the chemical field sensed by the walker 
at time t is given by: 



r ^ (AnD 1 nAi) d / 
and the gradient of the field is given by: 

t/At 



t/At 



y f PA [ w/9 exp -AnAt- ^ 1 ^"^" =Y<j> n , (3) 

Z-^ fAirD,nA^d/2 AD ± nAt ^ 
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W = _ E M0-^^) W (4) 
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where £*(t) is the i component of the particle position vector x c (t) and d is the dimen- 
sionality of the space in which particle movement occurs. Since the chemical decays in a 
time of the order 1/A then the concentration at time t will be approximately determined 
by the previous positions of the walker at times t' > t — 1/A. This implies that the sum in 
Eq.(J21) and Eq.(j3J) can be truncated at n max = 1/A At. Now consider the term x c (t — nAt). 
Since we are interested in the walker's behavior in the asymptotic limit t ^> 1/A, then 
nAt < n max At = 1/A C t Thus it is possible to replace the term x l c (t — nAt) in the above 
two equations by its Taylor series expansion. Keeping terms only to first order in At we 
have: 

Vln0(x c ,t) = V< f (Xc ' t) =-^. (5) 
^ ' ^ 0(x c ,t) 2D, y } 

Thus from Eq. (JIJ and the above equation, it follows that for long times, the behavior of the 
walker is dominated by the effective Langevin equation: 

mx c (t)+(l + ^)x c (t)=£(t). (6) 

It is not possible to systematically calculate corrections to this equation by keeping more 
terms in the Taylor expansion of the position terms. It can however be shown that such 
corrections are negligible in high dimensions, d ^> 2. These issues are discussed more fully 
in the Appendix. 

The modified Langevin equation Eq.© is clearly valid after some time t* such that 
t* ^> 1/A. We define 7 = (1 + na/2Di)/m and integrate Eq.© to get an equation for the 



time evolution of the i component of the velocity vector: 

1 " 



xl(t) = xl(t*) exp [- 7 (t - t*)} + 



m 



dt'exp [-j(t-t')]C(t'). 



(7) 



Then it follows that the velocity auto-correlation function is given by: 

(xi(t)xi(s)) = 4(t*) 2 exp [-j(t + s - 2t*)] 

D 



+ 



7m z 
-t 



exp (-7|a - t\) - exp [-7(5 + t - 2t*)\ 



(8) 



Using a Green-Kubo relation Z) R = f dt' (x % c {t)x l c (t')) it is possible to determine the effective 
(renormalized) particle diffusion coefficient Dr: 

xiit*^ 2 
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exp [- 7 (t-t*)](l-exp [- T (t -t*)}) 
Do 



+ 



7 2 m 2 



1 + exp [-2 7 (t - £*)] - 2 exp [-7^ - t*)] 



(9) 



which evaluated in the limit t — >• 00 leads us to the final set of results: 
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-1 a > 2Di 



(10) 
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We defer a discussion of the physics behind these results for later. For the moment we focus 
on the numerical validation of the theory. 

For the case of a self-attracting walker (« = 1) it is predicted that: (i) the asymptotic 
behavior is diffusion with a renormalized diffusion coefficient whose magnitude decreases 
with increasing values of the coupling parameter a, (ii) that the behavior is independent 
of dimension (superuniversality in the velocity correlations). We test these predictions by 
numerically integrating the model equations Eq.(^) and Eq. (j2*|) (see Fig.l). The diffusion 
coefficient in all simulations is calculated from the slope of plots of the variance versus time 
for the time range t e (10, 1000). The initial chemical concentration is a Gaussian centered 
at the origin, though any non-zero function is suitable. 

As expected, we find that the asymptotic behavior is diffusion characterized by renor- 
malized diffusion coefficients which are relatively independent of the dimension (Fig. 1). 
However there is some discrepancy between the theoretical values of Dr and the ones ob- 
tained from the numerics. Regression of the one-dimensional data in Fig. 1. shows that the 
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FIG. 1: (Color online) Plot of the renormalized diffusion coefficient Dr versus the non-dimensional 
coupling parameter /, where / = a/2D\. The parameter k equals one, implying that the walker 
has a tendency to explore previously visited spatial regions. The other parameters are m = 10~ 6 , 
Dq = 1, D\ = 1, A = 1, (3 = 1 and 5t = 0.1 with 10 samples. As predicted, the renormalized 
diffusion coefficient is the same in one, two and three dimensions. 

numerical data is best fit by an equation of the form (see Fig. 2): Dr = D (l + ka/2Di)~ 2 
where k = 0.81 ± 0.01 (10 4 realizations). The difference between this value and the theo- 
retical value of unity, stems from a combination of the approximations used in deriving the 
effective Langevin equation Eq.© and numerical error due to a finite time step (Note that 
the simulations are off-lattice and thus there is no numerical error due to a finite spatial 
step). As discussed in the Appendix, it is not possible to systematically calculate corrections 
to the effective Langevin equation. However by repeating the simulations with a time step 
an order of magnitude smaller than those in Fig. 1 and Fig. 2, we find that the value of k 
increases to k — 0.87 ± 0.02 (2 x 10 3 realizations), which is closer to the theoretical value. 
Hence it is probable that the discrepancies between numerics and theory are in significant 
part due to numerical error rather than to the approximations implicit in deriving Eq.©. 



6 



This is plausible since the next order correction to Eq. (jUJ) is proportional to the walker's ac- 
celeration x c (t) (see Eq. fll4|) in the Appendix) which is negligible for a self-attracting walker 
since the dynamics are over-damped for small coupling (m < 1) and become more strongly 
over-damped as the coupling increases (this is since the coefficient of the velocity term in 
Eq. (jnj) increases with the coupling). 
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FIG. 2: Plot of w = \J Dq / Dr versus the non-dimensional coupling parameter /, where / = a/2D\, 
for data obtained from ID simulations. Parameter values as in Fig. 1. This verifies the functional 
form predicted by theory. The solid line is the best fit through the data points. This line has a 
gradient of 0.81 and intercept of 0.99 - theory predicts a gradient of 1.00 and an intercept of 1.00. 

For the case of a self-repelling walker (/? = —1) theory predicts that: (i) if the coupling 
is less than a critical threshold, a < 2D ly then the asymptotic behavior is diffusion with 
a renormalized diffusion coefficient, (ii) if the coupling is above this threshold, a > 2Di, 
the particle diffusion coefficient diverges (iii) the behavior is independent of dimension. 
We tested these predictions by simulations. We find that near the predicted singularity, 
0.9 < a/2Di < 1, the variation of D R with coupling is given by: 

D R /D <x (l-^-)~ C , (11) 
7 



where ( = 2.10 ± 0.03 in one dimension, ( = 2.23 ± 0.02 in two dimensions and ( = 
2.10 ± 0.02 in three dimensions (Fig. 3). These estimates agree well with the theoretical 
value of ( = 2. The constant of proportionality in Eq.(|llj) is dependent on dimension, 
a feature not predicted by theory - interestingly, as shown in Fig. 3, the data in three 
dimensions is the one closest to the exact theoretical result. However these features are not 
completely unexpected. This is since the coefficient of the velocity term in Eq. (JHJ) decreases 
with increasing coupling, meaning that the acceleration of the walker becomes a determining 
factor as the critical coupling is approached. Thus the next order correction to Eq.© (see 
Eq. (jl4j) in the Appendix) is probably not negligible (unlike the case of a self-attracting 
walker). As discussed in the Appendix, these corrections are small in high dimensions 
and thus mostly significant in low dimensions. These theoretical arguments support the 
numerical data in Fig. 3. 

Now we numerically explore the walker's asymptotic behavior for a/2Di > 1. In this 
regime, the simulations break down after a few time steps. Using smaller values of the 
numerical time step does not help much and makes the numerical analysis computationally 
very expensive. This is overcome by simulating a model given by the equations: 



Since we are really interested in the case 5 = 0, we obtained data for several small values of 
5 in the hope that we could eventually extrapolate to the desired limit. As shown in Fig.4, 
we find that for a/2Di = 3 the renormalized diffusion coefficient clearly tends to infinity 
as 5 — > 0. This is found to be generally true for a/2D\ > 1, meaning that the purported 
transition at a/2D\ = 1 is from finite Dr to Dr = oo, in agreement with theory. Note that 
transitions in random walks with positive long-correlations are known 14], though in this 
case the dynamical transition is from normal- diffusion to super-diffusion in a one-dimensional 
space. 

Now we discuss the theoretical results from a physical perspective. In the absence of 
self-interaction, the walker's motion is determined by the frictional force which is directly 
proportional to its velocity rather than by inertia (over-damped dynamics). For the case of 
a self- attracting walker (/c = 1) it is expected that the walker spans space more slowly than 
for the case of no self-interaction: this typically means sub-diffusive behavior or diffusive 




(12) 



dt<f>{x, t) = DiV 2 0(x, t) - A0(x, t) + /36(x - Xc(*)). 



(13) 
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FIG. 3: Plot of the natural log of the renormalized diffusion coefficient Dr versus the natural log 
of the non-dimensional parameter 1 — /, where / = a/2D\. Note that the / values in this plot vary 
between 0.9 and 0.98, meaning that we are exploring the walker's behavior near the theoretically 
predicted singularity at / = 1. The parameter k equals minus one, implying that the walker has a 
tendency to explore previously unvisited spatial regions. The other parameters values are exactly 
as in Fig. I. This graph confirms that Dr oc (1 — /)~ 2 implying a singularity at / = I in all 
dimensions. 

behavior with a renormalized diffusion coefficient smaller than D . We have shown that to a 
first approximation obtained by truncating the walker's memory to a time of the order 1/A, 
the self-interaction leads to a renormalization of the frictional force. This implies that the 
dynamics are always over-damped and that the asymptotic behavior is that of renormalized 
diffusion, not sub-diffusion. 

For the case of a self-repelling walker (k, = —1) it is expected that the walker spans 
space faster than for the case of no self-interaction: this typically means super-diffusive 
behavior or diffusive behavior with a renormalized diffusion coefficient greater than D . We 
have shown that the self-interaction leads to a renormalization of the magnitude of the 
frictional force experienced by the walker. The frictional force decreases with increasing 
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FIG. 4: Determination of the renormalized diffusion coefficient Dr for / = 3 using the same 
parameters as Fig. 3. The model simulated is that given by Eq. (|12[) and Eq. (|I3|) . The solid line 
is the best fit through the data points, indicating that Dr oc log 10 (<5 _fc ) where k is some positive 
number. This suggests that in the limit 5 — > 0, Dr — > oo for / > I . 

coupling a between the walker's motion and the chemical field until at a particular value of 
the coupling, a = 2Di, the frictional force is exactly zero and the dynamics of the walker 
are purely determined by the inertial force. Thus the walker's behavior changes from one 
characterized by a low-Reynolds number for weak self-interaction to behavior characterized 
by a high Reynolds number as one approaches the critical coupling. When the coupling 
exceeds the critical value, we find that the walker experiences a force which is proportional 
to the velocity but which has the opposite effect of damping; the random fluctuations in 
the velocity due to the stochastic force are amplified rather than suppressed and thus the 
velocity of the walker increases uncontrollably with time, leading to an infinite velocity. 
This is the underlying reason for the divergence of the particle diffusion coefficient in this 
parameter regime. 

It is worthwhile to compare the walker's behavior with logarithmic response to the behav- 
ior with linear response. The linear response model was studied by Grima [10], who found 
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that if the particle diffusion coefficient (in the absence of self-interaction) is small then (i) 
for a self-attracting walker, the asymptotic behavior is that of renormalized diffusion (ii) 
for a self-repelling walker, the asymptotic behavior is renormalized diffusion below a critical 
threshold and ballistic diffusion above this threshold. The first difference to be emphasized 
between the two models with different responses is that for the logarithmic response the 
results are generally valid for any value of the particle diffusion coefficient and of the other 
parameters, whereas for the linear response model the results are restricted to small particle 
to chemical diffusion coefficients (small noise analysis). In other words the logarithmic re- 
sponse gives rise to behavior which is independent of the amplitude of the noise, an unusual 
property - for example, for intermediate to large noise, simulations indicate that the dynam- 
ics of a particle with linear response are not that of renormalized diffusion. It is also to be 
noted that the value of the critical coupling in the linear model is dimensionally dependent, 
unlike the superuniversal behavior in the present case. The logarithmic response V0/0 is 
weaker than the linear response V0 when > 1 and stronger otherwise. For the case of 
a self-attracting walker, the walker tends to stay in spatial regions which it has previously 
visited, meaning that the sampled chemical concentration at all times is significant and 
not small; thus in this case we expect that the walker with linear response to exhibit a 
stronger or at least equally strong perturbation of its motion compared to that with log- 
arithmic response. This reasoning agrees with our results. For the case of a self-repelling 
walker, the walker tends to avoid spatial regions which it has previously visited, meaning 
that the sampled chemical concentration tends to be very small; thus in this case we expect 
the walker with logarithmic response to exhibit a stronger or at least equally strong per- 
turbation of its motion compared to that with linear response. This qualitatively explains 
the onset of the diverging diffusion regime for logarithmic response compared to the onset 
of ballistic diffusion for linear response. 

As we mentioned in the introduction, the model has potentially some applications in 
biology. The self-driven many particle system is a model for chemotactic aggregation or 
dispersion, behavior exhibited by a number of organisms, such as the slime mould jlfil ]. 
The particles are then motile cells which secrete chemical and which simultaneously move 
up (or down) gradients of this chemical. The self-driven single particle can be thought of 
as a model for a chemotactic cell which is away from the bulk of other cells; in that case 
the cell will predominantly sense its own chemical rather than that of other cells. In the 
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linear response models studied by several authors, the cell's average velocity is assumed to 
be linearly proportional with the gradient of the local chemical field. In our model, the 
response is logarithmic which is known to be more realistic in some specific cases. This type 
of response is frequently referred to as the Weber-Fechner law and is thought to describe 
the sensory adaptation of a number of chemotactic cells to chemotactic signals, over certain 
concentration ranges ^6, Q, Q|. With this proviso, our present model may perhaps be 
applicable to understanding some features of sensory adaptation at the micro-organism 
level. 
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Appendix 



It is in principle possible to calculate the next order correction to Eq.© by retaining 
terms to second order in the Taylor series expansion of x l c (t — nAt) in Eq.fjSJ) and Eq. (jljl. 
Furthermore since the exponent is slowly varying, the the sums over n can be approximated 
by integrals, leading to: 



Vln0(x c ,t) 



x e (t) x c (t)At 
" 2D X ADi 



n 



l-d/2 



f(n) 



n=l 
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f(n) 
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(14) 



where 
f(n)- 



exp 
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I6D1 



(15) 

The integrals in Eq. (jl4j) cannot be computed exactly and approximations are also hard 
to come by, since we do not a priori know the magnitude of the walker's velocity x c (t) 
and acceleration x c (t), which appear in the argument of the exponent. The main problem 
here is that one has an implicit equation (given by Eq.(^) together with Eq.([14p) in the 
walker's velocity. The only fact which can be safely deduced is that for d ^> 2, the two 
integrals are approximately equal; this implies that the second term in Eq. (jl4|) vanishes 
in the limit At — > and that in high dimensions there are no further corrections to the 
modified Langevin equation Eq.(jHJ). Clearly in the formalism of the Langevin equation it is 
not easily possible to systematically calculate corrections to the modified Langevin equation 
Eq.©. However it is to be emphasized that the derivation of the latter equation (and the 
subsequent prediction of the phase transition), elude a treatment based on the equation of 
motion of the walker's probability density function. 
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